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In  the  classical  theory  of  competing  risks  (as  well  as  in  many  rellablllt 
models  and  Incomplete  data  problems)  it  is  assumed  that  (gf  the  risks  (i.e., 
the  random  variables  of  Interest)  are  independent  and  tKat  death  does  not 
result  from  simultaneous  causes.  Employing  probablllsC^  solution  to  a 
rela^t^d^^ro^lem  in  probability  modelling,  jde..Oibte4ii^ strongly  consistent  esti- 
mators,for  the  unobservable  marginal  distributions  of  interest.  These  esti- 
mators-j^are  analogous  to  those  of  Kaplan  and  Meier  [J.  Amer.  Statist.  Assoc. 
(1958)  631  and*are  appropriate  when  the  assumptions  of  independence  and  no 
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simultaneous  causes  of  death  fu)  and  (b)  , above>fail  to  hold.  Ua  ehow 
/htnrTTcnr  methods  can  be  used  to  unify  and  simplify  the  nonparametric  ap- 
proach toward  estimation  in  the  competing  risks  models  As  a consequence 
we  obtain  an  elementary  proof  of  the  strong  consistent^  of  the  Kaplan- 
Meier  estimator.  Our  results  extend  and  simplify  the  work  of  Peterson 
rj.  Amer.  Statist.  Assoc.  (1977)  72]  and  Desu  and  NarulaVlhe  Theory  and 
Applications  of  Reliability.  I.  ed.  by  I.  Shimi  and  C.  P.'Isokos  (1977)]. 
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models  and  inccunplete  data  problems)  it  is  assumed  that  (a)  the  risks  (i.e.. 


the  random  variables  of  interest)  are  independent  and  that  (b)  death  does  not 
result  from  simultaneous  causes.  Employing  our  probabilistic  solution  to  a 
related  problem  in  probability  modelling,  we  obtain  strongly  consistent  esti> 
mators  for  the  unobservable  marginal  distributions  of  interest.  These  estimators 
are  analogous  to  those  of  Kaplan  and  Meier  [J.  Amer.  Statist.  Assoc.  (1958)  ^ 
and  are  appropriate  when  the  assumptions  of  independence  and  no  simultaneous 
causes  of  death  [(a)  and  (b),  above]  fail  to  hold.  We  show  how  our  methods  can 
be  used  to  unify  and  simplify  the  nonparametric  approach  toward  estimation  in 
the  competing  risks  model.  As  a consequence  we  obtain  an  elementary  proof  of 
the  strong  consistency  of  the  Kaplan*Meier  estimator.  Our  results  extend  and 
simplify  the  work  of  Peterson  [J.  Amer.  Statist.  Assoc.  (1977)  72]  and  Desu 
and  Narula  [The  Theory  and  Applications  of  Reliability.  ed.  by  I.  Shimi  and 
C.  P.  Tsokos  (1977)]. 
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1.  Introduction  and  si—aty. 

Langberg,  Proschan,  and  Quinzi  (1978)  [hereafter  referred  to  as  LPQ  (1978)] 
show  that  under  certain  mild  conditions  it  is  possible  to  establish  a particular 
equivalence  between  an  arbitrary  system  of  dependent  components  and  a system  of 
independent  components.  The  two  systems  are  equivalent  in  the  sense  that  they 
possess  (1)  the  same  distribution  for  the  time  to  system  failure  and  (2)  the 
same  probabilities  of  occurrence  of  each  failure  pattern.  In  the  case  of  a 
series  system,  a particular  failure  pattern  occtirs  when  the  failure  of  a 
particular  set  of  components  coincides  with  the  failure  of  the  system.  The 
LPQ  (1978)  result  extends  results  by  Miller  (1977)  and  Tsiatis  (1975).  In 
Section  2 we  state  the  LPQ  (1978)  result.  Although  formulated  in  reliability 
terms,  the  result  applies  to  any  model  where  observations  consist  of  (1)  the 
tisM  at  which  a particular  event  occurs  and  (2)  the  identity  of  the  cause  or 
combination  of  causes  (among  a finite  rnasber)  which  results  in  the  occurrence 
of  the  event.  In  particular,  in  population  mortality  studies,  the  data  on 
each  subject  includes  (1)  the  age  at  death  and  (2)  the  cause (s)  of  death.  In 
this  case,  an  individual  dies  due  to  the  occurrence  of  one  or  more  of  a finite 
nu^er  of  possible  causes  of  death,  which  are  sometimes  viewed  as  "competing" 
for  the  individual's  life.  Moreover,  one  or  more  of  the  "causes"  might  be 
identified  with  withdrawal  of  an  individual  from  observation  [referred  to  as  a 
"loss"],  resulting  in  censored  or  truncated  data.  Thus,  the  LPQ  (1978)  result, 
as  well  as  the  methods  developed  in  this  paper,  apply  in  at  least  three  contexts 
of  interest— (1)  engineering  or  reliability  models,  (2)  competing  risks  models, 
and  (S)  various  models  involving  incomplete  data. 
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^ In  the  classical  theory  of  cosseting  risks  it  is  assumed  that  the  risks 
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I I act  independently  and  that  death  does  not  result  from  simultaneous  causes.  In 

\ Section  3 we  describe  the  competing  risks  model.  We  examine  the  classical 

I assumptions  and  introduce  the  Kaplan-Meier  (1958)  (K-M)  estimator.  Employing 

the  LPQ  (1978)  result,  we  obtain  in  Section  4 strongly  consistent  estimators 

i 

I for  the  unobservable  marginal  distributions  of  interest  in  the  competing  risks 

1 

model.  These  estimators  are  analogous  to  those  of  Kaplan  and  Meier  (1958) 
and  are  appropriate  when  the  asstjmptions  of  independence  and  no  simultaneous 
causes  of  death  fail  to  hold.  We  show  how  our  methods  can  be  used  to  unify 
! and  simplify  the  nonparametric  approach  toward  estimation  in  the  competing  risks 

I model.  As  a consequence  we  obtain  an  elementary  proof  of  the  strong  consis- 

tency of  the  Kaplan-Meier  estimator. 

Our  results  extend  and  simplify  the  work  of  Desu  and  Narula  (1977)  and 
Peterson  (1975,  1977).  Section  5 consists  of  proofs. 
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2.  From  a dependent  model  to  an  independent  one. 

In  this  section  we  state,  for  future  reference,  the  equivalence  result  of 
LPQ  (1978). 

To  state  our  model  precisely,  it  is  convenient  to  use  the  language  of 
reliability  theory  (system,  component,  etc.)  although  the  result  is  applicable 
in  a variety  of  other  contexts,  especially  in  the  context  of  competing  risks 
(see  Section  3) . A life  length  T is  a nonnegative  random  variable  such  that 
lim^_^  P(T  > t)  ■ 0.  Let  T ■ (Tj,  ...,  be  the  vector  of  component  life 
lengths  in  an  r-component  system  and  let  T denote  the  life  length  of  the 
system.  Let  I denote  the  collection  of  nonenq>ty  subsets  of  (1,  ...,  r).  For 
each  I e I, we  say  that  failure  pattern  I occurs  if  the  simultaneous  failure  of 
the  components  exclusively  in  subset  I coincides  with  the  failure  of  the 
system.  Define 

{I,  if  failure  pattern  I occurs 

otherwise. 

Let  and  T represent  the  vectors  of  coaqranent  life  lengths  of  two  systems 
whose  system  life  lengths  are  S and  T,  respectively.  We  say  that  the  two 
systems  are  equivalent  in  life  length  and  failure  patterns  (S^  ^ T^,  in  symbols) 
if 

P(S  > t,  US)  - I)  ■ P(T  > t,  C(p  - I),  t i 0. 

for  every  I e I. 

The  problem  can  now  be  stated  as  follows.  Given  the  vector  T ■ (T^,  ...,  T^) 
of  (possibly  dependent)  life  lengths,  determine  a random  vector  8 ■ (S^,  S^) 


such  that  S ^ T,  idtere  are  esqpressible  in  terns  of  independent 

randon  variables.  The  solution  is  found  by  letting  each  be  the  life  length 
of  a conponent  in  a theoretical  systeo,  where  the  conponents  are  exposed  to 
independent  sources  of  shock  as  follows.  Each  conponent  fails  if  it  receives 
a shock.  There  exists  one  source  of  shock  (sonetines  referred  to  as  a 
"hanaeman")  fbr  each  I e I.  A shock  from  source  I simultaneously  kills  the 
coi^wnents  exclusively  in  subset  I.  Let  denote  the  tine  (neasured  fron  the 
origin)  until  a shock  fron  source  I occurs.  Then  ■ nin(Hj,  i c I), 

1 ^ i ^ r,  and  S ■ H,  idiere  S > min(S|^,  1 ^ i s r)  and  H ■ nln(Hj,  I e I).  If 
the  randon  vector  T (and  thus,  S)  of  life  lengths  has  dinension  r,  then  the 
vector  H of  independent  tines  until  shock  has  dinension  2^  - 1 . The  nodel 
thus  allows  for  sinultaneous  failures  anong  the  conponents  in  the  original 
systea.  Define 


e*(H) 


I,  if  < Hj  for  each  J w I 


4,  otherwise. 


It  follows  that  £ ^ T if  and  only  if 


P(H  > t,  C*(H)  - I)  • P(T  > t,  «(T)  - I) 


(2.1) 


for  each  t 2 0 and  each  I e I.  If  (2.1)  holds  for  every  subset  I of  (1,  ...,  r). 


we  write  H ^T.  We  shall  use  the  following  notation  throughout.  For  every 


life  length  T with  distribution  function  P,  let  F(t)  ■ P(T  > t)  denote  the 
corresponding  survival  probability  and  let  a(P)  ■ suqp{t:  F(t)  >0).  LPQ  (1978) 
prove  the  following: 


^ii:_ 
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Theorw  2.1.  Let  T ■ min(Tj^,  1 s i s r)  denote  the  life  length  of  an  r-co^ionent 
series  systeo,  where  represents  the  life  length  of  cooqsonent  i,  i • 1,  r. 
Define  F(t,  I)  • P(T  > t,  CCD  - I)  and  F(t,  I)  - P(T  s t,  - I),  I e I. 

Then  the  following  statements  hold: 

(i)  A necessary  and  sufficient  condition  for  the  existence  of  a set  of  inde- 
pendent random  variables  {Hj,  I e 1}  which  satisfy  H ^ T , where  H ■ min(Hj,  I c I), 
is  that  the  functions  F(*,  I),  I c I,  have  no  common  discontinuities  in  the 
interval  [0,  a(F)). 

(ii)  The  random  variables  (H^,  I c 1}  in  (i)  have  corresponding  survival 
probabilities  (G^CO*  I e 7}  which  are  uniquely  determined  on  the  interval 
[0,  a(F)]  as  follows: 

G (t)  - n [F(a)/F(a')]  exp[./^(dF^(- , I)/?),  0 s t s a(F) . (2.2) 

ast 

Q 

where  F (•,  I)  is  the  continuous  part  of  F(',  I),  the  product  is  over  the  set 
of  discontinuities  (a)  of  F(*,  I),  I e I,  and  the  product  over  an  empty  set 
is  defined  as  unity. 

Remark  2.2.  Formula  (2.2)  is  defined  in  LPQ  (1978)  for  t in  the  half-open 
interval  [0,  a(F)).  The  present  formulation  is,  however,  equivalent. 

Remark  2.3.  In  Theorem  2.1,  suppose  that  failure  pattern  I is  non-occurring 
for  some  I e I,  i.e.,  stqypose  P(C(T)  • I)  ■ 0.  Then  F(t,  I)  • P(T  i t, 

C(T)  ■ I)  ■ 0 for  each  t 2 0.  By  (2.2),  = 1 on  the  interval  [0,  o(P)]. 

The  corresponding  random  variable  has  a distribution  which  places  no  mass  on 

the  interval  [0,  a(P)].  We  can  view  as  corresponding  to  a haammrman  who 
does  not  strike  in  the  interval  [0,  a(F)].  If  a(F)  ■ •, 


then  H|  is  degenerate 
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r-1 


at  infinity  (and  so  is  not  a life  length).  In  the  sane  way,  every  non-occurring 
pattern  can  be  associated  with  a haaneraan  idio  does  not  strike.  It  follows 
from  Theorem  2.1  that  if  the  original  system  has  exactly  a occurring  failure 
patterns,  1 ^ m s 2 - 1,  then  the  original  system  is  equivalent  in  life 
length  and  failure  patterns  to  a system  involving  the  sane  number  n of  inde> 
pendent  randoa  variables  (H^^,  1 s i s n}.  In  particular,  suppose  we  add  to 
the  hypothesis  of  Thetjrem  2.1  the  assumption  that  death  (failure)  does  not 
result  from  simultaneoiis  causes  (so  that  P(T^  ■ T^)  « 0 for  i * j).  Then 
the  original  system  has  at  most  r occurring  failure  patterns  and  so  can  be 
replaced  by  a system  involving  at  most  r independent  random  variables 

Remark  2.4.  Suppose  that  the  original  vector  T in  Theorem  2.1  is  itself  a 
vector  of  independent  random  variables  and  the  functions  F(*,  I),  I e 7,  have 
no  cozmon  discontinuities.  Then  it  is  not  difficult  to  show  that  a solution 
£ to  the  above  problem  is  such  that  and  T have  the  sane  distribution. 
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3.  The  independent  competing  risks  model;  the  Kaplan-Meier 
Let  there  be  a finite  number  of  causes  of  death  labelled  1,  r.  We 
associate  with  each  cause  j a nonnegative  random  variable  T ^ , j • 1,  r. 

■il\e  random  variable  represents  the  age  at  death  if  cause  j were  the  only 
cause  present  in  the  environment.  [In  a reliability  setting  denotes  the 
life  length  of  component  j in  a series  system  of  r components.  In  an  incomplete 
or  censored  data  problem,  one  of  the  random  variables  represents  the  time  at 
which  an  individual  becomes  "unobservable"  for  a reason  other  than  death,  while 
the  remaining  variables  typically  represent  various  causes  of  death.  The 
complete  collection  of  random  variables  T^,  ...,  T^  is  not  observed.  Instead, 
only  two  quantities  are  observed:  the  age  at  death  given  by  t ■ min(Tj,  ...,  T^ 
and  the  cause  of  death,  labelled  C,  given  by  the  subset  I of  {1,  ...,  r)  such 
that  T = Tj  for  each  i e I and  t * T^  for  each  i i I.  When  death  results  from 
exactly  one  of  the  r possible  causes,  as  is  usually  assumed,  then  C is  the 
index  i for  which  t = T^.  The  biomedical  researcher  is  interested  in  Biaking 
inferences  about  unobservable  quantities  (viz.,  the  random  variables  Tj,  ...,  T^) 
by  using  data  from  observable  quantities— in  this  case,  the  lifetime  t and 
the  cause  of  death  C.  In  particular,  he  seeks  to  estimate  the  marginal 
survival  probability  corresponding  to  a given  cause  (or  combination  of  causes) 
operating  along  without  competition  from  the  other  causes.  That  is,  he  wishes 
to  estimate  the  2^-1  survival  probabilities 

Mj(t)  ■ P(min(Tj,  j e J)  > t],  J c (l,  ....  r). 

In  analyzing  competing  risk  data,  various  authors  typically  assume  one 
or  more  of  the  following: 
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(Al)  The  risks  (i.e.,  the  random  variables  are  mutually  independent. 

(A2)  Death  does  not  result  from  simultaneous  causes.  [Consequently, 

PCTj  - T^)  ■ 0 for  i * j.] 

(A3)  The  distributions  of  T^,  ....  T^  have  no  common  discontinuities. 

(A4)  The  random  variables  Tj,  ....  T^  have  a joint  distribution  which  is 
absolutely  continuous. 

For  many  years  there  have  been  several  approaches  to  problems  of  estimation 
in  competing  risk  theory  which  employ,  in  varying  degrees,  the  above  assumptions. 
For  example,  the  assunq>tion  of  independence  (Al)  was  until  recently  almost 
universally  made  even  though  it  is  obviously  inappropriate  in  many  problems. 
Moreover,  assumptions  (A2)  through  (A4)  need  not  hold  in  certain  situations  of 
interest.  For  example,  (A2)  and  (A4)  do  not  hold  in  engineering  systems  where 
system  failure  can  occur  as  a result  of  the  simultaneous  failures  of  two  (or 
more)  conqponents.  Assuming  (Al),  (A2)  and  (A3),  Peterson  (1975,  1977)  shows 
how  the  Kaplan-Meier  estimator  may  be  expressed  as  a function  of  the  empirical 
counterparts  of  the  functions  F(*,  I),  I e I,  in  Theorem  2.1.  He  thus  indicates 
a way  to  obtain  strong  consistency  of  the  estimator  when  T is  a vector  of 
discrete  random  variables.  In  this  paper  we  show  how  Theorem  2.1  can  be  used 
to  approach  the  problem  of  estimating  the  marginal  distributions  of  interest 
in  a unified  way  without  making  any  of  the  assumptions  (A2) , (A3) , or  (A4) . 

We  assume  only  a weaker  version  of  (A3).  Moreover,  we  are  able  to  drop  the 
assuflq>tion  of  independence  (Al)  and  find  necessary  and  sufficient  conditions 
for  the  existence  of  consistent  estimators  for  the  marginal  distributions  of 
interest.  Peterson  (1975)  also  considers  the  case  of  dependent  risks.  In 
Section  4 we  show  how  our  methods  extend  and  siaplify  those  of  Peterson. 


9 


Let  ***'  '^rP'  ^ •••>  represent  a randcns  sample  frcns 

the  joint  distribution  of  the  nonnegative  randcns  variables  T^. 

Denote  the  marginal  distributions  (survival  probabilities)  of  T^, 
by  i • 1,  ...»  r.  For  each  I e I,  let  Mj(t)  ■ P(Tj  s t) , where 

Tj  • min(Tj^,  i e I).  Assume  (Al),  (A2),  and  (A3).  Then  the  cause  of  death 
■ i if  and  only  if  for  each  j w i,  1 s i,  j s r.  For  each 

i « 1,  n,  only  and  are  observed,  idiere  Tj^  ■ min(Tj^,  T^j^)  and 
■ j whenever  Consider  the  case  r ■ 2 and  suppose  we  seek  to 

estimate  the  marginal  survival  probability  M^(t)  ■ P(Tj  > t).  Let 


0=T...  s...  ST,  . denote  the  ordered  values  of  the  observations 

(0)  (1)  (n) 


^1*  ^n’  Kaplan-Meier  (K-H)  estimator  of  Mj(t)  is 


M,(t)  - n [(n  - i)/(n  - i ♦ 1)]. 
* i 


where  the  product  is  over  the  ranks  i of  those  ordered  observations 


1 s i s n,  such  that  s t < and  corresponds  to  a death  from 


cause  1 some  j).  If  corresponds  to  a death  from  cause 


(3.1) 


1,  then  F?j(t)  is  defined  to  be  zero  for  t > Otherwise,  fij(t)  is 

undefined  for  t > [In  the  original  fonsulation  by  Kaplan  and  Meier  (19S8), 

corresponded  to  the  time  until  death,  idiile  T2  represented  the  time  at  which 
a loss  occurred.] 

The  K>M  estimator  (3.1)  is  a step  function  with  jumps  at  those  observations 
which  correspond  to  a death  from  cause  1.  If  no  death  from  cause  2 is  observed 
[no  loss  ocoirs],  then  each  observation  corresponds  to  a death  from  cause  1. 

In  this  case  (3.1)  reduces  to  a step  function  with  jumps  of  height  1/n  at  each 
T.,  thus  yielding  the  usual  empirical  estimate  of  M^(t). 
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Peterson  (1^7S)  considers  the  following  straightforward  extension  of  (3,1)  r 

for  the  survival  probabilities  Mj(t)  ■ P(Tj  > t),  J c {i,  r),  where  f 

A 

Tj  ■ inin(Tj,  J e J)  and  r i 2.  The  (extended)  K-M  estimator  Mj  is  given  by 

^T(t)  - n ((n  - i)/(n  - i ♦ 1)1,  (3.2)  - 

i 


where  now  the  product  is  over  the  ranks  i of  those  ordered  observations 
such  that  ^ t < and  corresponds  to  a death  from  at  least  one 
cause  j e J.  Conventions  analogous  to  those  used  in  defining  (3.1)  also  hold 
in  (3.2)  when  t > 

Assuming  independence  (Al),  no  simultaneous  causes  of  death  (A2),  and 
disjoint  sets  of  discontinuities  for  the  marginal  distributions  (A3),  Peterson 
(1977)  Indicates  a way  to  obtain  strong  consistency  of  the  K-M  estimator  (3.1) 
in  the  special  case  when  the  random  variables  T^,  ...,  are  discrete. 

Breslow  and  Crowley  (1974)  etc.  Breslow  and  Crowley  (1974)  and  Meier  (1975) 
show  that  the  estimator  is  asymptotically  normal  and,  as  a process  in  t, 
converges  to  a normal  process.  More  recently,  Aalen  (1976)  shows  that  the 

A A 

bivariate  vector  of  K-M  estimators  (1  - F?j^(tj^),  1 - ^^(t^))  is  as)nq>totically 
bivariate  normal,  and  that,  regarded  as  a bivariate  process  in  t^  and  t2, 
converges  to  a normal  process.  Estimators  analogous  to  (3.1)  and  (3.2)  are 
proposed  in  the  next  section  by  using  formula  (2.2)  of  Theorem  2.1.  Such 
extensions  will  apply  in  situations  where  the  assumptions  of  independence  (Al) 
and  no  simultaneous  causes  of  death  (A2)  fail  to  hold. 


! 

ii 


;j 

ij 


4.  The  dependent  case. 

In  this  section  we  show  how  fonaula  (2.2)  can  be  used  to  unify  and 
sioplify  the  noi^wrantetric  approach  toward  estimation  in  the  competing  risks 
model  when  independence  of  risks  is  not  assumed.  First,  we  show  how  (2.2) 
easily  establishes  a functional  relationship  between  distributions  of  "theoretical" 
random  variables  [the  (H^,  I g 1}  of  Theorem  2.1]  which  are  unobservable  (but 
estimable)  and  the  marginal  distributions  1 s i s r,  (of  unobservable 
variables)  for  which  we  seek  estimates.  Under  a weaker  version  of  assumption 
(A3),  consistent  estimators  analogous  to  (3.2)  are  given. 

In  the  probabilistic  problem  discussed  in  Section  2,  our  solution  (Theorem 
2.1)  can  be  described  as  follows.  Replace  the  given  series  system  of  dependent 
components  by  a "theoretical"  system  vdiose  component  life  lengths  are  expressible 
in  terms  of  independent  random  variables  so  as  to  preserve  the  joint  distribution 
of  system  life  length  and  failure  patterns.  The  components  in  the  so-called 
theoretical  system  are  exposed  to  shocks  from  "hammermen"  whose  striking  times 
Hj,  I c I,  have  distributions  defined  by  (2.2).  A series  system  of  r components 
with  depen''ent  life  lengths  T^^,  ...,  T^,  and  system  life  length 
T ■ min(T^,  1 s i s r)  becomes,  in  the  terminology  of  competing  risks,  an 
individual  exposed  to  r dependent  risks  of  death,  where  T^  represents  the 
age  at  death  if  risk  i were  the  only  risk  present  in  the  environment, 
i ■ 1,  ...,  r.  In  this  section,  unless  otherwise  indicated,  we  drop  the 
assumption  (Al)  of  independent  risks.  Kith  respect  to  the  estimation  problem 
posed  in  Section  3,  formula  (2.2)  exhibits  a relationship  between  distributions 
of  observable  quantities  and  distributions  associated  with  theoretical  variables 
Hj,  I e 7,  which  are  unobservable.  The  observable  quantities  in  the  competing 
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risks  model  are  the  life  length  t ■ min(T^,  1 s i s r)  and  the  cause  of  death 
C.  The  functions  associated  with  these  observable  quantities,  viz.,  the  survival 
probability  F(t)  ■ PCT  > t)  and  the  monotonic  functions  F(t,  i)  ■ P(T  S t, 
C^*i),  l^i^r,  appear  on  the  right  hand  side  of  (2.2).  Thus  replacing 
F(t)  and  F(t,  i)  in  (2.2)  with  their  eiiq>irical  counterparts  allows  us  to 
estimate  the  distributions  G^,  1 s i sr,  associated  with  the  unobservable 
variables  1 ^ i ^ r.  However,  the  distributions  G^,  1 s i s r,  are,  in 
general,  different  firom  the  marginal  distributions  N^,  1 s i sr,  idiich  we 
seek  to  estimate.  The  natural  question  then  is  how  to  relate  the  unobservable 
(but  estimable)  functions  G^,  1 s i s r,  to  the  marginal  distributions 
M^,  1 s i s r.  More  generally,  how  can  we  relate  the  functions  M^,  I e I,  to 
the  survival  probabilities  I e I,  given  by  (2.2)?  One  answer  can  be 
given  as  follows.  That  is,  suppose  for  a moment  that  T^,  ...,  T^  are,  in  fact, 
independent  and  that  the  following  holds: 

(A3)'  The  functions  F(*,  I),  I e I,  in  Theorem  2.1  have  no  connon  discontinuities. 
Then  by  Remark  2.4,  G^  ■ M^,  i > 1,  ...,  r.  Consequently, 


M,(t)  - n M.(t)  - n G.(t) 
^ iel  ^ l6l  ^ 


for  every  t e [0,  a(F)].  What  ore  the  corresponding  estimators?  It  is  a 
siaple  exercise  to  show  that  in  the  case  r ■ 2,  if  we  replace  the  functions 
F(t)  and  F(t,  1)  on  the  right  in  (2.2)  by  their  esqpirical  counterparts,  then 
the  resulting  statistic  is  the  K-M  estimator  (3.1)  of  P(Tj  > t).  In  view  of 
(4.1),  if  r is  an  arbitrary  integer  greater  than  2,  a reasonable  estimator  for 
Rfj(t)  ought  to  be  n ?^(t),  where  the  product  is  over  iel  and  is  the 
function  resulting  from  (2.2)  by  replacing  the  functions  F(*)  and  F(>,  i)  with 


(4.1) 
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their  eaplrical  counterparts,  i ■ 1,  r.  Again,  it  is  easy  to  show  that 
the  resulting  statistic  is,  in  fact,  the  (generalized)  K-M  estimator  (3.2) 
for  Mj(t).  Thus,  in  the  case  of  independent  risks,  (2.2)  leads  directly  to 
well-known  estimators  possessing  several  optimal  properties.  It  is  therefore 
reasonable  to  expect  that  (2.2)  also  plays  a role  in  the  estimation  problem 
when  the  risks  are  mutually  dependent . This  is,  indeed,  the  case. 

Theorem  4.1.  [Peterson  (1975)].  Let  T^,  ...,  T^  be  nonnegative  random 
variables  satisfying  (A2)  and  (A3)  [but  not  necessarily  (Al)].  Let  P be  a 
partition  of  (1,  ...,  r)  and  define  1 s i s r,  as  in  (2.2).  Then  for 

each  t e [0,  a(F)], 


j Mj(t)  ■ Gj^(t)  for  each  1 c P 

j 

if  and  only  if 

P(T  > t,  C(T)  e I)  ■ /*  M-,(x)  dMj(x)  for  each  I c P. 


(4.2a) 


(4.2b) 


idiere  I*  denotes  the  coiq>lefflent  of  I in  (1,  ...,  r). 

Peterson  (1975)  uses  an  operator  defined  on  a space  of  distribution 
functions  to  prove  an  equivalent  version  of  Theorem  4.1.  Employing  Theorem 
2.1,  we  give  a proof  which  is  considerably  sio^ler.  The  following  notation 


and  leana  is  useful  in  interpreting  (4.2a,  b). 

Let  (T^,  1 ^ i 5C  r)  and  (T^*,  1 s i s r}  be  two  collections  of  random 
variables.  For  each  function  f of  the  random  variables  T^,  ...,  T^,  let  f* 
denote  the  value  of  the  same  function  of  T^*,  ...,  T^*.  For  each  set  I 
belonging  to  a partition  P of  (1,  ...,  r),  define  Fp(t,  I)  * P(T  > t,  C(T)  c I). 
On  the  right  in  (2.2),  replace  F(t,  I)  by  Fp(t,  I)  and  call  the  resulting 
expression  p(t). 
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The  following  sinple  leiaa  is  useful  in  proving  Theorea  4.1: 

Le— a 4.2.  Assume  the  hypothesis  of  Theorem  4.1.  Let  T^*,  ...»  T^*  be 
independent  random  variables  such  that  Tj*  and  Tj  have  the  same  distribution 
(i.e.,  Mj*  • Mj)  for  each  I e P.  Then  (4.2a)  is  equivalent  to 


*!>  • S.P 


for  each  I e P, 


(4.3a) 


and  (4.2b)  is  equivalent  to 


¥y(t,  I)  • I)  for  each  I e P.  (4.Sb) 

Proof.  By  (A2)  and  (A3),  we  have  that  Mj  and  have  no  conaon  discontinuities 
and  P(Tj  ■ Tj)  ■ 0 for  each  I,  J e P,  I w J.  Since  Mj  • Mj*,  we  deduce  that 
P(T-*  « T *)  ■ 0 for  each  I,  J e P,  I w J.  It  follows  from  Reaark  2.3  that  if 
P has  exactly  k members,  2 ^ k ^ r,  then  each  of  the  collections  (1'j*  1 c P) 
and  (Tj*,  I e P)  has  at  most  k occurring  failure  patterns.  By  Reaark  2.4, 

Mj*  - Gj,p  (-  Mj).  (4.4) 

By  (2.2)  and  the  fact  that  Fp(t,  I)  ■ L . F(t,  i). 


®I,P  ■ "iel  ®i* 


(4.S) 


A simple  calculation  shows  that 


(4.6) 


The  conclusion  fbllows  froa  (4.4),  (4.5),  and  (4.6).  || 

We  now  give  the  following  eleaentary  proof  of  Theorea  4.1. 


IS 


Proof  of  Theorem  4,1.  By  Lenma  4.2,  it  is  enough  to  show  that  (4.3a)  holds 
if  and  only  if  (4.3b)  holds. 

Suppose  first  that  (4.3b)  holds.  Since 

F(t)  = FpCt,  I)  and  F*(t)  = F*(t,  I). 

it  follows  from  (2.2)  that  G j p ■ ^j*p. 

Conversely,  suppose  that  (4.3a)  holds.  It  follows  from  (2.2)  that 
F > n Gj  p and  F*  ■ n G|*p,  where  each  product  is  over  I e P.  Since 

I)  - p 

and 

v(t.  I) . r;  (f*/g,y  dG,;, 

for  each  I e P,  relation  (4.3b)  holds.  | | 

One  drawback  of  Peterson's  formulation  is  that  the  assumption  of  no 
simultaneous  causes  of  death  (A2)  does  not  hold,  e.g.,  in  an  engineering 
system  where  system  failure  can  occur  as  a result  of  the  simultaneous  failure 
of  two  or  more  components.  Moreover,  Peterson  (197S,  1977)  assumes  that  the 
marginal  distributions  of  , . . . , have  no  common  discontinuities  (A3) . 

In  Theorem  4.4  below  we  give  necessary  and  sufficient  conditions  for  a 
functional  relation  to  exist  between  the  functions  in  (2.2)  and  the  functions 
Mj  tdiich  we  seek  to  estimate  without  assuming  (A2).  Our  only  assunqption  is 
that  the  functions  F(*,  I),  I e 7,  have  no  common  discontinuities  in 
[0,  a(F)]  [assimqption  (A3)'].  Assumption  (A3)  implies  (A3)',  but  the 
converse  does  not  hold. 
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k. 


Another  disadvantage  in  Peterson's  (1975)  approach  can  be  described  as 
follows.  In  order  to  establish  a relation  between  the  function  M.  for  an 
individual  subset  J of  (1,  ....  r}  and  the  functions  G^,  I e I,  in  (2.2), 
Peterson  (1975)  requires  that  (4.2b)  hold  simultaneously  for  each  set  I in 
a partition  P of  { 1 , . . . , r)  which  contains  J . In  general , it  is  not  difficult 
to  construct  joint  distributions  which  satisfy  none  of  the  conditions  in  (4.2b) 
yet  for  which  at  least  one  relationship  exists  between  the  function  Mj  and 
the  survival  probabilities  G^,  I e I. 

Example  4.3.  Let  the  discrete  random  vector  (T^,  T2)  have  a joint  probability 
distribution  as  given  in  Table  4.1  below: 


Table  4.1.  Distribution  of  (Tj,  T2) 


T 

Tj\‘2 

2 

4 

6 

1 

1/24 

1/8 

1/12 

3 

1/12 

1/16 

0 

5 

1/6 

1/6 

1/6 

A simple  calculation  verifies  that  G^  given  by  (2.2)  equals  but  S'2  * M^. 
Purthexmore,  neither  of  the  conditions  (4.2b)  is  satisfied.  Thus,  Theorem  4.1 
above  is  not  applicable  in  this  siople  example.  We  will  show,  however,  that 
our  generalization  of  Theorem  4.1  (Theorem  4.4  below)  does  apply  here.  Before 
we  state  Theorem  4.4,  it  will  be  conveneint  to  introdiice  the  following  notation. 
Let  Ij  ■ (J  e 1:  J n I w ^).  Let  F(t,  Ij)  ■ P(T  > t,  5(T)  e Ij).  Recall 
that  the  cause  of  death  is  subset  I [i.e.,  C(T)  ■ I]  if  and  only  if  T ■ T^  for 


i 
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each  i e I and  T « T.  for  each  i i I.  Thus,  F(t,  Ij)  ■ JP(T  > t,  C(T)  ■ J)  ■ 
^F(t,  J),  where  each  sum  is  over  J e 7^.  For  each  function  G,  let  D(G) 

[C(G)]  denote  the  set  of  discontinuities  (continuities)  of  G.  Note  that  if 
the  functions  F(*,  I),  I e I,  have  no  common  discontinuities,  then  D[F(*,  7^)]  ■ 
u D[F(>,  J)],  where  the  union  is  disjoint  over  sets  J e 7j. 

Theorem  4.4  below  resembles  Theorem  4.1  in  that  we  find  necessary  and 
sufficient  conditions  for  a relationship  to  exist  between  the  functions  M^, 

I e 7,  and  the  survival  probabilities  G^j,  I e 7,  given  by  (2.2).  It  generalizes 
Theorem  4.1  in  the  following  ways.  First,  the  assumption  (A2)  of  no  simultaneous 
causes  of  death  is  dropped.  Secondly,  we  assume  a weaker  version  of  assumption 
(A3),  namely  the  assvaq>tion  (A3)'  that  the  functions  F(>,  I),  I e 7,  have  no 
comnon  discontinuities. 

Theorem  4.4.  Let  T^,  . . . , T^  be  nonnegative  random  variables  satisfying  (A3)'. 
Let  I e 7.  Then  for  each  t e [0,  a(F)], 


Mj(t)  - n G (t) 

JeJj 

if  and  only  if  the  following  two  conditions  hold: 


(4.7) 


F(a)/F(a’),  aeD(F(.,  7j)) 


Mj(a)/Mj(a‘) 


otherwise. 


(4.8a) 


P(Tj,  i t|Tj  - t)  - P(Tj,  > t|Tj  > t), 


(4.8b) 


where  Gj  is  given  by  (2.2). 
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The  proof  of  Theoren  4.4  is  given  in  Section  S. 

Reaark  4.5.  Suppose  that  the  random  variables  Tj  ■ ■inCT^,  i e I),  I e I, 
have  absolutely  continuous  distributions.  Let  BjCt)  [M^Ct)]  and  BjijiCt) 
p4i|i,(t)]  denote  respectively  the  density  (distribution)  function  and  condi- 
tional density  (distribution)  function  of  Tj  and  given  Tj,  > t.  Then 
condition  (4.8b)  is  equivalent  to 

■l|l,(t)/Mi|i,(t)  - inj(t)/Mj(t). 

In  other  words,  the  conditional  failure  rate  function  of  T^  given  T^,  > t is 
equal  to  the  (unconditional)  failure  rate  function  of  T^.  Stated  differently, 
the  random  variables  T^  and  Tj,  are  independent  "along  the  diagonal  T^  ■ Tj,". 

Desu  and  Narula  (1977)  arrive  at  a condition  similar  to  (4.8b)  in  the  special 
case  idien  the  assumption  of  absolute  continuity  (A4)  [and  hence  also  (A2)] 
holds. 

Note  that  conditions  (4.8a,  b),  in  contrast  to  (4.2b),  apply  to  only  one 
subset  I e I at  a time.  Consequently,  we  can  proceed  in  Example  4.3  as  follows. 

It  is  easy  to  verify  that  conditions  (4.8a,  b)  hold.  Since  2 1,  it 

follows  from  Theorem  4.4  that 

Ne  have  previously  remarked  that  the  assunq>tion  (A2)  of  no  simultaneous 
causes  of  death  is  unrealistic  in  certain  models  of  interest.  An  important 
family  of  multivariate  distributions  for  which  assumption  (A2)  fails  is  the 
family  of  multivariate  exponential  (MVB)  distributions  of  Marshall  and  Olkin 
(1967).  Ne  Illustrate  with  an  example.  I 
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Example  4.6.  For  simplicity,  suppose  that  the  random  vector  (T^,  T^)  has  the 
Marshall-Olkin  bivariate  exponential  distribution  with  survival  probability: 

P(Ti  > tj.  - exp[.Ajtj  - - Aj2  »ax(tj.  t2)]. 

^2  ^ ® ^2’  ^12  ^ bhe  marginal  distributions  Mj  and  Ii2 

are  continuous,  condition  (4.8a)  trivially  holds.  Condition  (4.8b)  with 
I > (1)  states  that 

P(T2  s t|Tj  - t)  - P(T2  > t|Tj  > t). 

An  easy  computation  shows  that  these  conditional  probabilities  are  each 
equal  to  exp(-X2t).  Thus,  Theorem  4.4  may  be  applied  when  the  joint  distri- 
bution belongs  to  the  family  of  Marshall-Olkin  MVE  distributions,  whereas 
Theorem  4.1  cannot  be  applied  here  since  (A2)  fails. 

In  Section  3 we  assumed  that  the  risks  were  mutually  independent  (Al)' 
and  that  the  functions  F(*,  I),  I c I,  had  no  comnon  discontinuities  (A3)*.  ' 

Under  these  assunptions  the  basic  formula  (2.2)  yielded  the  K-M  estimators 
for  the  marginal  distribution  Mj  (r  ■ 2)  and  the  functions  Mj,  I e I,  (r  i 2). 

In  a similar  fashion  formula  (2.2)  (via  Theorem  4.4)  can  be  used  to  determine 
strongly  consistent  estimators  for  the  functions  Mj,  I e I,  in  the  iiportant 
practical  cases  when  independence  fails  to  hold  and  simultaneous  causes  of 
death  are  allowed. 

The  key  tool  we  shall  use  in  establishing  consistent  estimators  for  tlie>  ' 
marginal  distributions  of  interest  is  given  in  Theorem  4.7  below.  First  we 
introduce  some  notation.  As  above,  T - (Tj,  ...,  T^  is  a vector  of  nonnegative 


20 


I 


random  variables,  t > min(Tj,  1 s j s r)  represents  the  life  length  of  an 

individual  exposed  to  r risks  of  death  and  C represents  the  cause  of  deathi^ 

where  C ■ J if  and  only  if  t ■ for  each  j e J and  t w for  each  J i J, 

J e 7.  For  each  I e 7 and  Borel  set  A,  let  F(A,  I)  ■ P(t  e A,  C ■ !)•  Let 

T have  distribution  function  F and  let  D(I)  [C(I)]  be  the  set  of  discontinuities 

[continuities]  of  the  function  F(*,  I).  There  exists,  by  Theorem  2.1,  a 

collection  {H^,  I e 7}  of  independent  random  variables  such  that  H ^ T , where 

H ■ mln(H^,  I e 7).  Moreover,  the  probability  G^j(t*)  ■ P(Hj  i t)  nay  be  ' 

obtained  from  (2.2).  Now  let  T.  «CT,.,.. .,T, ),!■!,  2,  ...,bea  > 

“1  11  ri 

sequence  of  nonnegative  random  vectors  (representing  a sequence  of  individuals) 
and  let  Tj^,  5^,  Fj(*,  I)*  Fj^,  D(I,  i),  C(I,  i),  Hj  Hj^,  and  Gj  be  the 
analogues  of  t,  C,  F(*,  I),  F,  D(I),  C(I),  Hj,  H,  and  G^j  above.  Let  F^(F*^) 
denote  the  continuous  (discontinuous)  part  of  F. 

Theorem  4.7.  Suppose  the  following  conditions  hold: 

4(i)  For  1 * J,  the  pair  {F(',  I),  F(«,  J))  as  well  as  each  pair  {Fj^(«,  I), 

J))*  f * 7,  2,  ...,  have  no  common  discontinuities. 

4(ii)  For  I e 7 and  0 :£  t s a(F), 

4(lli)  For  I e 7, 

lim  sup  |F  (([0,  u)  n D(I)).),  I)  - F°([0,  u],  I)|  - 0. 
rt**»  0$t^(P) 

4(iv)  lim  sup  |P  (t)  - F(t)(  - 0. 
nr^  0st^(F) 
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Then  for  I e I and  0 s t s o(F), 

lim  Gj^^Ct*)  - Gj(t*).  (4.9) 

n 

The  proof  of  Theoren  4.7  is  given  in  Section  5. 

Consider  now  the  estimation  problem  posed  above.  Let  T^  ■ ^li'  •'*»  "^ri^* 
i « 1,  2,  ...,  be  independent  and  identically  distributed  as  T ■ (Tj,  ...»  T^). 

A 

Replace  F(*,  I)  and  F by  their  empirical  counterparts,  F^('»  I)  and  F^, 

respectively,  on  the  right  in  (2.2).  The  resulting  expression,  call  it  , 

1 

is  an  estimator  for  G^.  Assume  that  T satisfies  (4.8a,  b).  Then  (4.7)  holds. 

A natural  estimator  for  Mj(t)  in  this  case,  then,  is 

1 „(t)  » n ^(t).  (4.10)  ; 

Jelj 

Such  an  estimator  will  be  strongly  consistent  if  for  every  J e Ij, 
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-1  ” 

^D(I).n^^^  " ® to.  t]  n D(I),  5^  - I}. 


It  follows  that 


and 


‘’nt**  “ ^’CCI),!!  * *’D(I),n 


F = Z Ft  • 

" lel 


C4.12) 


(4.13) 


Ife  denote  the  common  domain  of  all  random  variables  by  0.  To  prove  (4.11).  it 
suffices  to  verify  conditions  4(i)  - 4(iv)  of  Theorem  4.7  for  almost  every 
(It  e 0. 

Condition  4(i)  holds  trivially.  By  the  strong  law  of  large  numbers,  we 
have  that  as  n ■>  “. 


Fc(i).n(0  F ([0.  t].  I)  a.s..  t i 0 


(4.14) 


and 


^D(I)  ^ C[0»  J)  a*Se>  t ^ 0* 


Condition  4(ii)  follows  from  (4.14).  By  the  Glivenko-Cantelli  Theorem. 


lim  sup  |f_(t)  - F(t)|  0 a.s. 

tiO  " 


(4.15) 


(4.16) 
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I 


r 

Thus,  condition  4(iv)  holds.  Since  the  function  F ([0,  t],  I)  is  a continuous 
function  of  t,  it  follows  that  the  convergence  in  (4.14)  is  uniform  in  t. 

Thus,  we  nay  conclude  from  (4.12)  and  (4.16)  that  the  convergence  in  (4. IS) 
is  uniform  in  t 2 0 and  so  condition  4(iii)  holds. 


Renark  4.8.  Let  0 = t ^ ^ (1)  ^ ^ ^ (n)  ordered  values  of 

Tj,  ...,  T^.  In  analogy  with  the  Kaplan-Meier  estimator  (3.2),  thr  estimator 
(4.10)  nay  be  expressed  as  follows: 


M,(t)  - n [(n  - i)/(n  - i ♦ 1)], 
* i 


(^ 


where  the  product  is  over  the  ranks  i of  those  ordered  observations  t 


(i)’ 


1 s i s n,  such  that  i t < and  corresponds  to  a death  from  the 
simultaneous  causes  j e J,  J e Ij.  If  for  some  i,  « T^^  for  each  j e J, 
J e Ij,  then  (4.17)  is  defined  to  be  zero  for  t > Otherwise,  (4.17)  is 


undefined  for  t > t 


(n)‘ 


In  view  of  Remark  4.8  emd  the  preceding  argument,  we  have  proven: 


Theorem  4.9.  In  the  competing  risks  model  of  Section  3,  assume  only  that  the 
functions  P(*,  I),  I e I,  have  no  common  discontinuities,  and  the  joint  distri- 
bution of  (Tj^,  ...,  Ty)  satisfies  (4.8a,  b).  Then  the  estimator  (4.17)  is 
strongly  consistent  for  M^. 

Remark  4.10.  To  show  consistency  of  the  K-N  estimator  in  the  independent  case, 
Peterson  (1977)  must  rely  on  a property  of  an  operator  defined  on  a space  of 
discrete  distribution  functions  (which  he  states  without  proof).  If  we  assume 
that  the  risks  are  independent  and  that  assusqption  (A3)«  holds,  then  by  applying 
Theorem  4.7  above,  as  we  did  in  the  dependent  case,  we  not  only  have  a stronger 
proof  of  the  consistency  of  the  K-M  estimator  [since  (A3)  implies  (A3)'],  but 
also  (me  which  is  considerably  more  elementary. 


4 

I 


I 


.17)  ! 


j 

I 
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5,  Proofs. 

Before  we  give  a proof  of  Theorea  4.4,  we  state  two  leaBas  which  are 
proven  in  LPQ  (1978). 

Lemsa  5.1.  For  every  probability  neasure  Q (with  a possible  atoa  at  •*)  such 
that  Q(0~)  ■ 1,  and  every  t & 0,  the  following  holds: 

Q(t)  - exp(-/!(dQ%  • n [Q(a)/Q(a‘)]. 

ast 


(5.1) 


where  the  product  is  over  the  set  (a)  of  discontinuities  of  Q,  and  the  product  over 
an  empty  set  is  defined  to  be  1. 

hama.  5.2.  Let  (G|,  I e 7}  be  a collection  of  survival  probabilities 
satisf]ring  (2.2).  Then  for  each  I c 7 and  t e [0,  a(F)), 

fF(t)/r(t‘),  t c D(F(-,  D) 


Gl(t)/Gj(t') 


otherwise. 


Proof  of  Theorem  4.4.  Suppose  (4.8a,  b)  holds.  By  (4.8a), 

D(F(-.  7j))  - D(Mj),  7 e 7. 

For  every  Borel  set  Be  [o,  a(F)), 

F(B,7j)  5 P(T  e B,  C(T)  c 7j) 

• P(Tj  e B,  Tj  S Tj,) 

- / PCTj,  Jt  u|Tj  - u)  dMj(u) 

- / P(Tj,  > u|Tj  > u)  dMj(tt)  [by  4.8(b)l 

■ / [lP(u)/iT.(u))  dM.(u). 

B * * 


(5.2) 
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Thus,  for  ©very  Borel  set  B = (0,  a(F)), 


F(B.  I.)  - / (F/M-)  dM-. 

B * * 


Relations  (5.2)  and  (5.3)  together  imply  that 

dF‘^(-,  Ij)/dMj^  - F/Mj. 


It  follows  that 


n G,(t)  - exp{-/J[dF^(-,  I,)/Fl}  n (F(a)/F(a-)1 

^ a£D(F(.,  Ij)) 

- exp{-/J(dMj^/Mj]}  n [M  (a)/Mj(a')] 

acD(M-) 

(by  4.8a] 

■ Mj(t)  [by  Lemna  5.1]. 

Conversely,  suppose  (4.7)  holds.  By  (2.2)  and  Leona  5.1, 

exp{-/J[dF^(.,  I )/F]}  n [F(a)/F(a’)] 

ait 

aeD(F(-,  Ij)) 

- exp(-/J(dM/^/M,)]  n [M  (a)/M  (a")]. 

* ast  * 

aeO(Mj) 

Letting  n denote  the  product  over  sets  J e Ij,  we  have 

Mj(a)(Mj(a")  - n[?rj(a)]/n(S‘j(a’)] 
n[F(a)/F(a’)],  a e D(F(*,  J)) 

m • 

1 otherwise 

[F(a)/F(a'),  a e D(F(.,  Ij)) 


(5.3) 


(5.4) 


1 


otherwise 
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Thus,  (4.8s)  holds.  Equation  (4.8b)  follows  from  (5.4)  hy  cancellation.  || 
Before  we  prove  Theoren  4.7,  we  sake  two  ejqplsnatory  rsnsrks. 

Rsnark  5.3.  Asswptions  4(i)  and  4(ii)  of  Theoren  4.7  together  inply  that 
for  I c 7, 

lin  sup  |F_((t),  I)  - P((t),  1)1  ■ 0. 

0st<a(P)  " 

Rs— rk  5.4.  Rensrk  5.3  implies  that  for  I e I, 

m 

D(I)  cun  0(1.  k). 
n>l  ksn 

The  proof  of  Theoren  4.7  is  based  upon  the  following  three  lennas. 
he— s 5.5.  Under  assunptions  4(i)-4(iv)  of  Theoren  4.7, 

o 5 1^  a(F  ) i a(P). 

hoof.  It  suffices  to  consider  the  case  a < •.  Let  (n)  be  an  arbitrary 
infinite  subsequence  of  (1,  2,  ...)  such  that  lin  o(Fj^)  - o.  By  definition, 
^ClvO,  lii'!  F[o(F^)J  a 0.  Hence  F(a)  » Q.  Relation  (5.5) 
follows  from  the  definition  of  o(F).  || 

In  Lsmss  5.6  and  5.7  below,  let  (n)  denote  an  arbitrary  infinite  std>- 
sequence  of  (1,  2,  ...),  let  I e I,  and  let  0 s t s a(F). 

I^t 

and 
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Then 


Hi  bJ  ^(t)  s 


(5.6) 


Proof.  By  Patou's  Lesma, 


TG*  bJ  (t)  s I Tli  X (a)  *n|!Tl(*)/1^  (•")]. 

nr*-  *»■  aeD(I)  »*-  D(I,«)  n [0,  t)  n [0,o(P  ))  « ■ . 


By  Renark  5.3,  lin  Xnrr  ^ ^ ^ D(I).  By  LeaM  5.5,  lin  x (a) 

^ ^ »*-  (0,t)  n [0,a(P^)) 

■ X[o  Assumption  4(iv)  inplies  that 

lin  in[F^(a)/Fj^(a‘)]  - tn[F(a)/F(a‘)J. 


Relation  (5.6)  follows. 


5.7.  Let 


■ Z X (a)  ln[P  (a)/F  (a*)) 

aeD(I,a)  [0,t)  n [0,a(P  ))  n C(I)  “ “ 


and 


n [0,o(PJ)/^ 


B,^t)  •lx  (a) 


■'2  i*"/  ~ L * ln[F(a)/F(a')) 

aeD(I)  (0,t)  n (0,<i(P))  n C(I) 


(o{t)^*^^*^  n [0.o(F))/^  H 


Than 


(5.7) 


t 
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P>oof.  Let  e > 0.  By  4(1), 


" [0.a(F^))  n 


■ -/  X (u) 

[0,t)  D(I,«)  n C(I)  n [0.a(FJ) 


1/F«({u}.  I) 

lii[l  ♦ F„({u).  I)/F^(u)l  d F^(u,  I) 


for  ■ sufficiently  large  by  4(iv).  Again  by  4(iv), 


Hence 


‘ ‘ " (0.o(F^))'^  ^ 

n [0,a(F.))/^  D 


for  0 < 8 < t.  It  follows  froB 


5.S  that 


Therefbre,  for  b sufficiently  large. 


b!  _(t)  4 2 c ♦ e/FCt)  -/  (Xcri^/n  d F^(-.  I). 

Using  the  Helly>Bray  TheorsB,  we  conclude  froa  4(li)  that 

1/  S ‘(«:U 

for  every  4 such  that  0 < < < t.  Relation  (5.7)  is  established  by  letting 
« ♦ 0.  1 1 
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Proof  of  Theorem  4.7.  Let  lel,  o(F)»  and  {m}  be  an  arbitrary  infinite 

subsequence  of  {1,  2,  By  (2.2), 

By  Lennas  5.6  and  5.7, 

^ e*P[B}(t)  ♦ B^(t)l  - G^j(t*). 

By  Theorea  2.1,  we  may  conclude  that 


Thus, 

F(t*)  - lim  n 
lel 

Hence,  lim  G,  (t*)  ■ 
*»■ 


P(T  i t)  - n G.  (t*). 

■ lel 

Gj  (t*)  s n TSTg  (t*)  s n G-(t*)  - f(t*). 

lel  **■  lel  ^ 

GjCt).  II 
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